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Abstract 

We consider a new model for shunting inhibitory cellular neural networks, retarded functional dif¬ 
ferential equations with piecewise constant argument. The existence and exponential stability of almost 
periodic solutions are investigated. An illustrative example is provided. 
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1 Introduction 

Cellular neural networks ( CNNs ) have been paid much attention in the past two decades [I]- pH]. Ex¬ 
ceptional role in psychophysics, speech, perception, robotics, adaptive pattern recognition, vision, and 
image processing is played by shunting inhibitory cellular neural networks (SICNNs), which was in¬ 
troduced by Bouzerdoum and Pinter nu. One of the most attractive subjects for this type of neural 
networks is the existence of almost periodic solutions. This problem has been investigated for models 
with different types of activation functions Ham In the present study, we investigate a new model of 
SICNNs by considering deviated as well as piecewise constant time arguments, and prove the existence 
of exponentially stable almost periodic solutions. All the results are discussed for the general type of 
activation functions, but they can be easily specified for applications. 

Extended information about differential equations with generalized piecewise constant argument m 
can be found in the book |22| . As a subclass, they contain differential equations with piecewise constant 
argument ( EPCA ) [23]-[30]. where the piecewise constant argument is assumed to be a multiple of the 
greatest integer function. 

Differential equations with piecewise constant argument are very useful as models for neural networks. 
This was shown in the studies eum where the authors utilized EPCA. We propose to involve a 
* Corresponding Author Tel.: +90 312 210 5355, Fax: +90 312 210 2972, E-mail: marat@metu.edu.tr 


1 



new type of systems, retarded functional differential equations with piecewise constant argument of 
generalized type, in the modeling. It will help to investigate a larger class of neural networks. 

In paper EH, differential equations with piecewise constant argument of generalized type ( EPCAG ) 
were introduced. We not only maximally generalized the argument functions, but also proposed to reduce 
investigation of EPCAG to integral equations. Due to that innovation, it is now possible to analyze 
essentially non-linear systems, that is, systems non-linear with respect to values of solutions at discrete 
moments of time, where the argument changes its constancy. Previously, the main and unique method 
for EPCA was reduction to discrete equations and, hence, only equations in which values of solutions 
at the discrete moments appear linearly [23]-[30] have been considered. 

The crucial novelty of the present paper is that the piecewise constant argument in the functional 
differential equations is of alternate (advanced-delayed) type. In the literature, biological reasons for 
the argument to be delayed were discussed Elisa. However, the role of advanced arguments has not 
been analyzed properly yet. Nevertheless, the importance of anticipation for biology was mentioned by 
some authors. For example, in the paper m , it is supposed that synchronization of biological oscillators 
may request anticipation of counterparts behavior. Consequently, one can assume that equations for 
neural networks may also need anticipation, which is usually reflected in models by advanced argument. 
Therefore, the systems taken into account in the present study can be useful in future analyses of 
SICNNs. Furthermore, the idea of involving both advanced and delayed arguments in neural networks 
can be explained by the existence of retarded and advanced actions in a model of classical electrodynamics 
133 ■ Moreover, mixed type deviation of the argument may depend on traveling waves emergence in 
CNNs [7J- Understanding the structure of such traveling waves is important due to their potential 
applications including image processing (see, for example, ra-ci). More detailed analysis of deviated 
arguments in neural networks can be found in |38|-|40|. 

Shunting inhibition is a phenomenon in which the cell is “clamped” to its resting potential when the 
reversal potential of Cl~ channels are close to the membrane resting potential of the cell OH HU. It occurs 
through the opposition of an inward current, which would otherwise depolarize the membrane potential 
to threshold, by an inward flow of Cl~ ions m- From the biological point of view, shunting inhibition 
has an important role in the dynamics of neurons [32]-[33]. According to the results of Vida et al. 
[42] networks with shunting inhibition are advantageous compared to the networks with hyperpolarizing 
inhibition such that in the former type networks oscillations are generated with smaller tonic excitatory 
drive, network frequencies are tuned to the 7 band, and robustness against heterogeneity in the excitatory 
drive is markedly improved. It was demonstrated by Mitchell and Silver [ 35] that shunting inhibition 
can modulate the gain and offset of the relationship between output firing rate and input frequency in 
granule cells when excitation and/or inhibition are mediated by time dependent synaptic input. Besides, 
Borg-Graham et al. [44] proposed that nonlinear shunting inhibition may act during the initial stage 
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of visual cortical processing, setting the balance between opponent ‘On’ and ‘Off’ responses in different 
locations of the visual receptive field [44] . On the other hand, shunting neural networks are important for 
various engineering applications For example, in vision, shunting lateral inhibition enhances 

edges and contrast, mediates directional selectivity, and causes adaptation of the organization of the 
spatial receptive field and of the contrast sensitivity function cmira. Moreover, such networks 
are appropriate to be used in medical diagnosis [53] . Therefore, the investigation of the dynamics of 
SICNNs , which are biologically inspired networks designed upon the shunting inhibition concept in , is 
important for the improvement of the techniques used in medical diagnosis, adaptive pattern recognition, 
image processing etc. [45 ] - [53! and may shed light on neuronal activities concerning shunting inhibition 

m-m- 

Exponential stability of neural networks has been widely studied in the literature (see, for example, 
na-imiMi-En!). According to Liao et al. E2, the exponential stability has importance in neural net¬ 
works when the exponentially convergence rate is used to determine the speed of neural computations. 
The studies mm were concerned with the exponential stability and estimation of exponential conver¬ 
gence rates in neural networks. In the paper m , Lyapunov-Krasovskii functionals and the linear matrix 
inequality (LMI) approaches were combined to investigate the problem, whereas the boundedness of the 
Dini derivative of the neuron input output activations was required in m ■ The exponential stabilization 
problem of memristive neural networks was considered in m by means of the Lyapunov-Krasovskii func¬ 
tional and free weighting matrix techniques. Additionally, the Lyapunov-Krasovskii functional method 
was considered by Wen et al. ED to analyze the passivity of stochastic impulsive memristor-based piece- 
wise linear systems, and the free weighting matrix approach was utilized in E3 to derive an LMI based 
delay dependent exponential stability criterion for neural networks with a time varying delay. On the 
other hand, exponential stability criteria were derived by Dan et al. [551j for an error system in order 
to achieve lag synchronization of coupled delayed chaotic neural networks. The concept of lag synchro¬ 
nization was taken into account also within the scope of the papers [62] and [63] for memristive neural 
networks and for a class of switched neural networks with time-varying delays, respectively. Furthermore, 
the Banach fixed point theorem and the variant of a certain integral inequality with explicit estimate 
were used to investigate the global exponential stability of pseudo almost periodic solutions of SICNNs 
with mixed delays in the study m- 

Almost periodic and in particular quasi-periodic motions are important for the theory of neural net¬ 
works. According to Pasemann et al. [64] , periodic and quasi-periodic solutions have many fundamental 
importances in biological and artificial systems, as they are associated with central pattern generators, 
establishing stability properties and bifurcations (leading to the discovery of periodic solutions). Besides, 
the sinusoidal shape of neural output signals is, in general, associated with appropriate quasi-periodic 
attractors for discrete-time dynamical systems. In the book [65], the dynamics of the brain activity is 
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considered as a system of many coupled oscillators with different incommensurable periods. Signals from 
the neurons have a phase shift of tt/2, and may be useful for various kinds of applications; for instance, 
controlling the gait of legged robots Furthermore, an alternative discrete time model of coupled 

quasi-periodic and chaotic neural network oscillators were considered by Wang Ell- 

Let us describe the model of SICNNs in its most original form m- Consider a two dimensional 
grid of processing cells arranged into m rows and n columns, and let Cij, i = 1 , 2 ,... ,m, j = 1,2,... ,n, 
denote the cell at the (i,j) position of the lattice. In SICNNs, neighboring cells exert mutual inhibitory 
interactions of the shunting type. The dynamics of a cell Cij are described by the following nonlinear 
ordinary differential equation, 

^ = O'ijXij — 'y ' C^ f(Xkl(t))Xij +Lij(t), ( 1 . 1 ) 

Cki€N r (i,j) 

where Xij is the activity of the cell Cij ; Lij (t) is the external input to the cell Cij ; the constant > 0 
represents the passive decay rate of the cell activity; > 0 is the coupling strength of postsynaptic 
activity of the cell Cu transmitted to the cell C l3 ; the activation function f(xu) is a positive continuous 
function representing the output or firing rate of the cell Cu’, and the r—neighborhood of the cell Cij is 
defined as 


N r (i, j ) = {Cki : max(|fc — i\,\l — j\) < r, 1 < k < to, 1 < l < n}. 

It is worth noting that even if the activation function is supposed to be globally bounded and Lips- 
chitzian, these properties are not valid for the nonlinear terms in the right hand sides of the differential 
equations describing the dynamics of SICNNs, and this is one of the reasons why a sophisticated math¬ 
ematical analysis is required for SICNNs in general. Another reason is that the connections between 
neurons in SICNNs act locally only in r— neighborhoods. This causes special ways of evaluations dif¬ 
ferent than those customized for earlier developed neural networks in the mathematical analyses of the 
models. 

It is reasonable to say that the usage of deviated arguments in neural networks makes the models 
much closer to applications. For example, in m the model was considered with variable delays, 

^ = -CkjXij - C ijf( x ki(t - T(t)))xij + Lij(t). (1.2) 

C k i£N r (i,j) 

In the present study, we introduce and investigate more general neural networks. The model will be 
described in the next section. 
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2 Preliminaries 


Let Z and R denote the sets of all integers and real numbers, respectively. Throughout the paper, the 

norm ||w|| = max \uij\ , where u = {%} = (itn, ..., u i„,..., u m 1 ..., it mn ) € R mxn , will be used. 
ihj) 

Suppose that 0 = {9 p } and £ = {£ p }, P £ Z, are sequences of real numbers such that the first one is 
strictly ordered, \9 P \ —> oo as \p\ —> oo, and the second one satisfies 9 p < £ p < 0 p+ i for all p £ Z. The 
sequence ( is not necessarily strictly ordered. We say that a function is of 7 —type, and denote it by 7 (t), 
if 7 (t) = ( p for 9 p < t < 9 p+ 1 , p £ Z. One can affirm, for example, that 2 
with Op = 2p — 1 , = 2 p. 

Fix a non-negative number r £ R and let C° be the set of all continuous functions mapping the 
interval [—r, 0] into R, with the uniform norm ||<^||o = max \<p(t)\ . Moreover, we denote by C the 

ts[—T,0] 

set consisting of continuous functions mapping the interval [—r, 0] into R mx ™, with the uniform norm 

Iloilo = max || 0 (t)||. 
te[— t,o] 

In the present study, we propose to investigate retarded SICNNs with functional response on piece- 
wise constant argument of the following form, 

7 , = O'ijXij ^ ' Cij f {Xklti %kl"/(t))Xij T Ljj (t), (2-3) 

c M eN r (i,j) 

where / : C° x C° —> R is a continuous functional. 

In network ( 12 . 31 ) . the terms xut and must be understood in the way used for functional 

differential equations [SB]-[7D]. That is, Xkit(s) = Xki(t + s) and Xki-y(t)( s ) = + s ) for s G [—r, 0]. 

Let us clarify that the argument function q(t) is of the alternate type. Fix an integer p and consider 
the function on the interval [9 p , 9 p+ 1 ). Then, the function y(t) is equal to £ p . If the argument t satisfies 
0 P < t < £ p , then "/(t) > t and it is of advanced type. Similarly, if £ p < t < 0 p +i, then y(t) < t and, hence, 
it is of delayed type. Consequently, it is worth noting that the SICNN ( 12.311 is with alternate constancy 
of argument. It is known that 7 (t) is the most general among piecewise constant argument functions 
[22j . Our model is much more general than the equations investigated in m-m, where the delay is 
constant r = 1 and it is equal to the step of the greatest integer function [t\. Differential equations with 
functional response on the piecewise constant argument were first introduced in the paper m ■ In the 
present study, we apply the theory to the analysis of neural networks. All previous authors were at most 
busy with terms of the form x(q (t)). Thus, one can say that retarded functional differential equations 
with piecewise constant argument in the most general form is investigated in this paper. 

Since the model (12.311 is a new one, we have to investigate not only the existence of almost periodic 
solutions and their stability, but also common problems of the existence and uniqueness of solutions, 
their continuation to infinity and boundedness. 

One can easily see that system (H3 is a particular case of (12.31) . Additionally, results of the present 


t + 1 


is a 7 —type function 
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paper are true or can be easily adapted to the following systems, 


= -dijXij - Y C ij fi X kl{l(t))) x ij + Lij{t), 
Cki£N r (i,j) 

that is, differential equations with piecewise constant argument, EPCAG, 


(2.4) 


dxij 

dt 


-CtijXij - Y C ijf( x kl(t - T(t)),Xkl(j(t) - T(t)))Xij + Lij(t ), 
C k i£N r (i,j) 


differential equations with variable delay and piecewise constant argument, 


(2.5) 


-AA = -dijXij - Y C ijf( x ki{t-T(t)))xij- Y D ij9( x ki{'y(t)))x ij +Lij{t). (2.6) 

C k iEN r {i,j) C kl EN r (i,j) 

In other words, what we have suggested are sufficiently general models, which can be easily specified for 
concrete applications. 

Let us introduce the initial condition for SICNN (ESP - Fix a number a £ R and functions <f = {cf>ij} , 
ip = {ipij} £ C, i = 1, 2,..., m, j = 1, 2,..., n. In the case 7 (er) < d, we say that a solution x{t) = {xij(t)} 
of (12.31) satisfies the initial condition and write x{t) = x{t, <j,<f>,ip), t > a, if x a (s) = </>(s), x 7 ( cr ) (s) = ip(s) 
for s € [—r, 0]. In what follows, we assume that if the set [ 7 ( 0 -) — r, 7 (d)] U [a — r, a\ is connected, then 
the equation <j>(s) = ip(s + a — 7 (a)) is true for all s £ [—r, 7 (d) — a]. If 7 (a) > a, then we look for a 
solution x(t) = x(t,(r,4 0, t > d, such that x a (s) = <f>(s),s £ [—r,0]. Thus, if 9 p < a < 9 p+ 1 for some 
p £ Z, then there are two cases of the initial condition: 

(ICi) x a (s) = 4>(s), (j) £ C, s £ [-r, 0] if 0 P < a < ( p < 0 P+ 1 ; 

(ic 2 ) x a (s) = 4>(s), x 7 ( ff )(s) = 4>{s), G c, s £ [ t , 0 ], if Op < Cp < d < 0 P+ 1 . 

Considering SICNN (12.31) with these conditions, we shall say about the initial value problem (IVP) for 
m- To be short, we shall say only about IVP in the form x(t,cr,(f>,ip), specifying x(t,a,4>) for (ICi), 
if needed. Thus, we can provide the following definitions now. 

Definition 2.1 A function x(t ) = {xij(t)} , i = 1,2,..., m, j = 1,2,..., n, is a solution of with 
(/Ci) or ( IC 2 ) on an interval [a, a + a) if: 

(i) it satisfies the initial condition; 

(ii) x(t) is continuous on [d,d + a); 

(in) the derivative x'(t) exists for t > a with the possible exception of the points 0 p , where one-sided 
derivatives exist; 
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(iv) equation (El is satisfied by x(t ) for all t > a except possibly at the points of 6, and it holds for 


the right derivative of x{t) at the points O p . 

Definition 2.2 A function x(t) = {xij(t)} , i = 1,2,... ,m, j = 1,2,... ,n, is a solution of \2.i-ft) on R 
*/■ 


(i) x{t) is continuous; 

(ii) the derivative x'(t) exists for all t £ R with the possible exception of the points 9 P , p £ Z, where 
one-sided derivatives exist; 

(iv) equation El is satisfied by x(t) for all t £ R except at the points of 9, and it holds for the right 
derivative of x(t) at the points 9 p , p £ Z. 

The existence and uniqueness of solutions of El will be investigated in the next section. 


3 Existence and uniqueness 

Throughout the paper we suppose in SICNN (12.31) that 70 = min a.y > 0 and C(j are non-negative 

(id) 

numbers. 

The following assumptions are required. 

(Cl) The functional / satisfies the Lipschitz condition 


H/W’nV’i) - /W> 2 , "02)11 < L( ll^i - </> 2 ||o + ||-0i - V> 2 ||o), 


for some positive constant L, where (0i,-0i) and (<fo, -ifo) are from C° x C°; 

(C2) There exists a positive number M such that sup |/‘(0, 0)| < M; 

(c/>,l/>)£C°xC° 

(C3) There exists a positive number 9 such that 9 p+ 1 — 9 p <9 for all p £ Z; 

(C4) \Lij(t)\ < Lij for all i,j and t € R, where are non-negative real constants. 

In the remaining parts of the paper, the notations p = max C(., c = max 

(i.j) ‘ ^ (i,j) 

c kl eN r (i,j) 

y ^ (jkl 

d = max — c k‘ GN r( l d) — l J_ /. _ max m.. anc i J = max —ti will be used. We assume that p9M < 1 and 
(id) 20^-70 - ~ 

Mc< 1. 


E c kl eN r (i,j) C ij 


(i,j) 


(id) a,ij 

Let us denote Ch 0 = {<)>€ C : ||^||o < Ho}, where Hq is a positive number. 


Lemma 3.1 Suppose that the conditions (Cl) —(C4) hold and fix an integer p. If Hq is a positive number 
2 L(H q + 9L) ‘ 


such that p9 


M + 


1 — p9M 

unique solution x(t) = x(t, a, (f>, if) of li2.S\) on [a, 9 p+ i\. 


< 1, then for every £ [9 p ,9 p + 1 ] x Ch 0 x Ch 0 there exists a 
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Proof. We assume without loss of generality that 8 P < a < f p < 9 p+ i. That is, we consider (IC\) and 
the solution x(t , cr, (f>). 

Fix an arbitrary function <p £ Ch 0 ■ Let us denote by A the set of continuous functions u(t) = {uij(t)} , 

i = 1,2,..., m, j = 1, 2,..., n, defined on [a — t, 0 p +i] such that u a (t) = <j>{t), t £ [—r, 0], and ||tx|| : < Kq, 

where Wu^ = max ||u(f)|| and K 0 = g ° + -A 
te[cr,e p+ 1 ] 1 — fiOM 

Define on A an operator such that 


-a), t£[a- r,a], 

(*«(*))« = E 

J ' T c kl eN r (ij) 

X f {ukls ? 'U'kl'y(s) (^) ^ ^ [^^p+l]* 


One can confirm that |(<fru(f))f,| < Ho + ( 'mKq C^j + LjO. t £ [cr, 0 p +i], Accordingly, the 

C k ieN r (i,j) 

inequality || ( hu || 1 < Ho + (hMKq + L)9 = Kq is valid. Therefore, <f>(A) C A. 

On the other hand, if u(f) = {^(t)} and w(f) = {t’y (f)} belong to A, then we have for t £ [a, 9 p+ i\ 
that 


- ($u(i))»j| < f e ay( * s) E C ij \f( u kis,u kh ( s ))\\uij{s) -Vij(s)\ds 
Ja C kl £N r (i,j) 

+ f e~ aij{t ~ s) E C ij \f( u kis,u kh ( s )) - f(.v k is,v kh ( s) )\ |%(s)| ds 
Ja c kl eN r (i,j) 

<9(M + 2K 0 L)\\u-v\\ 1 E C iK 

c h ieN r (i,j) 


Hence, the inequality ||$it — < hn || 1 < p9(M + 2 KqL) ||m — vj11 j holds. Because p,9(M + 2KqL) = p9 M 


2L(H 0 + 8L) 


1 - n9M 
on [cr, 0 p+ i], □ 


< 1, the operator $ is a contraction. Consequently, there exists a unique solution of (12.31) 


The next assertion can be proved exactly in the way that is used to verify Lemma 2.2 from 
we use Lemma 13.II 


if 


Lemma 3.2 Suppose that the conditions (Cl) — (C4) hold and fix an integer p. If Hq is a positive number 
2 L(H 0 + 9l)- 


such that p9 


M 


< 1, then for every (a,<p,ijj) £ [9 P ,9 P + 1] x Ch 0 x Ch 0 there exists a 


1 — p9M 

unique solution x(t) = x{t 1 cr 1 (j>,if), t > a, of t2.3\) . and it satisfies the integral equation 


Xij(t)=e ay(t CT) <M0)- / e ay(t s) E C^f(xki s ,x khis) )x i j(s)-L ij (s) 

Ja C kl eN r (i,j) 


ds. 


(3.7) 















4 Bounded solutions 


In this section, we will investigate the existence of a unique bounded solution of SICNN (12.31) . Moreover, 
the exponential stability of the bounded solution will be considered. An auxiliary result is presented in 
the following lemma. 


Lemma 4.1 Assume that the conditions (Cl) — (C4) are fulfilled. If Hq is a positive number such that 
2L{H 0 + eL)~ 


fiO 


M 


1 — pOM 


< 1 , then a function x(t) = {xijft)} , i = 1,2 ,..., m, j = 1 , 2, ..., n, satisfying 


sup ||a;(f)|| < Hq is a solution of f2.3l) if and only if it satisfies the following integral equation 

i 6 R 




/ 

J —c 




'y '] Cij f (xklsi Xkij^s^Xij (s) Lij (s) 

Cu&N r (i,j) 


ds. 


(4.8) 


Proof. We consider only sufficiency. The necessity can be proved by using (13.71) in a very similar way 
to the ordinary differential equations case. One can obtain that 


/ 




y Cij fiXkl^Xki^Xijis) Lij{s) 

C kl £N r (i,j) 


ds 


E c % • l -.)- 

13 C k i£N r (i,j) 

Therefore, the integral in (14.81) is convergent. Differentiate (14.811 to verify that it is a solution of (12.31) . □ 
The following conditions are needed. 


(C5) p6 


M 


2 L(H + 6L) 


1 - pOM J 

(C6) {M + 2LH)c< 1; 


< 1, where H = 


l 


1 - Me 


(C7) 2d 


M + LHe^ T / 2 


(l + e 70 ®/ 2 ^ 


< 1 . 


The main result concerning the existence and exponential stability of bounded solutions of (12.31) is 
mentioned in the next theorem. 


Theorem 4.1 Suppose that the conditions (Cl) — (C6) hold. Then, 12.3 1) admits a unique bounded 
on R solution, which satisfies JC#| ). If, additionally, the condition (C7) is valid, then the solution is 
exponentially stable with exponential convergence rate 70/2. 


Proof. Let Co(R) be the set of uniformly continuous functions defined on R such that if u(t) £ Co(R), 

then Halloo < H, where ||u||oo = sup ||u(t)||. Define on Co(R) the operator II as 

teR 


( n u(t))ij = - 


a, a ij s ) 


Z_ j 

c k ieN r (i,j) 


C \j f {^kls 1 r U j kl / f(s)) r U J ij (^) 


ds. 


(4.9) 
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If u(t) = {uij(t)} , i = 1, 2,..., m, j = 1,2,..., n, belongs to C'o(M), then we have that 


|(n«(t))y|<y^ £ c§Mfr + L ij )d a = ^-( 


C k i£N r (i,j) 


^ CVMH + Lu 
c kl eN r (i,j) 


Utilizing the last inequality one can show that ||(IIu)|| < cMH + l = H. Therefore, Hu(t) £ C'o(R). 

Let us verify that this operator is contractive. Indeed, if u[t) = {uij(t)} and v(t) = {vij(t)} belong 
to Co(K), then 

|(rht(f))ij - (IIt;(t)) ij -| < f e _Qy(t_s) Y C ij \f(uki s ,u khis ))\ |tiy(s) -Vij(s)\ds 

J — OO y— ~\t / • -\ 


c kl eN r (i,j ) 


3 a ij s ) 


^ ^ | fi^kls i 'U J kl'-y(s )) fields ? '^kl'y(s) ) | 


C k ieN r (i,j) 


+/' 

< r J2 CVMluijW-VijMds 

J —OO _ „ /_• 

+/ 


c k ,eN r {ij ) 


D a ij(t s) 


^ \ C^jHL ^/c^s|lo T ||^'/c/7(s) Vkl-y(s) || o) ^ 


< (M + 2 LH) 


C k i<EN r (i,j) 

E f~<kl 

C k l £N r (i,j) °ij 


\u - u 


Hence, the inequality ||nu — < (M + 2LH)c ||it — u|| is valid. In accordance with condition (C6), 

the operator n is contractive. Consequently, SICNN (E3D admits a unique solution v(t) = {vij(t)} that 
belongs to Co(R). 

We will continue with the investigation of the exponential stability. Fix an arbitrary number e > 0 
and let 6 be a sufficiently small positive number such that a.\ < 1, a 2 < 1, a 3 < 1 and IC(S) < e, where 


^ 1 -2 d[M + LHe^r/ 2^1 + e 7 0 e/2)] 

and a 3 = /x0(M + 2 LH) + 2p0L/C(<5). 


, a.\ = fid 


M+ 


2L{H + S + 8L) 


1 - nOM 


, a 2 = (M+2LH)c+4:LdlC(5) 


Suppose that V a (s) = r/(s), s £ [— r, 0]. Let u(t) = {uij(t)} be a solution of the network (12.111) with 
Ucr(s) = (f>(s), s £ [—r, 0], where the function tp satisfies the inequality || <p — 77 H 0 < 6. Without loss of 
generality we assume that 'y(cr) > a. Using Lemma 111.21 one can verify for t > a that 


Uij(t) - Vij(t) =e ay(t a) {<j>ij{ 0)-77ij(0)) 


- / e 


—an It— 


y \ C-jj f {uki s , 1Lkl~/{s))'U , ij{.s) fi^kls > Vkl'y(s)) r Vij (s) 

C kI £N r (i,j) 


ds. 


Denote by w(t) = {wij(t)} , the difference u(t) — v(t). Then, w(t) satisfies the relation 


Vi j {t) = e- a **-°H<ki(P)-T Hj {0))- f e -a «( t - s ) Y, C%[f(v kls + 

Ja C k i<EN r (i,j ) 


WklsT VkL'y(s) T ^ ? fc/7(s) ) i^ij (^) f {^kls > ^fcZ7(s) )^ij ($) 


ds. 


(4.10) 
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We will consider equation (14.101) for a = 0. Let 'La be the set of all continuous functions w(t) 


{wij(t)} which are defined on [—r, oo) such that: 

(i) w(t) = <j){t) - r}{t), t e [-r, 0]; 

(ii) w(t) is uniformly continuous on [0,+oo); 

(iii) ||wj(f)|| < /C((i)e _7o4/2 for t > 0. 

Define on $j an operator IT such that 


- rjijit), t e [-r,0], 

= e- Oi ^(0y(O)-r?y(O))- f e“ ay(t " s) E C% f{v kU + 

J ° C kl eN r {i,j) 

Wkl S ,V k lj(s ) +'Wfei 7 ( S ))(^ij(s) + Wij(s)) - /(Vkls^kl^^Vijis) ds , t > 0. 


We shall show that II : fUa —► Indeed, it is true for t > 0 that 

\{flw(t)) ij \<e- a v t 6+ f e - a « (t " s) E C ij 

C k i£N r (i,j) 

x | f(vkls+Wkls,V kh (s) +U!klj( S )) ~ f(vkla,v k ly( a )) I |«y(s)| ds 

4“ f ^ V; ^ ^ ^ Cij | f (vkls 4” ‘Wklsi‘Ukl r Y(s) 4” ^ 7 fcZ7(s))| I ^ij (^) I ds 

c kl eN r (i,j) 

< e -oM+ /V“«<‘-»> Y CgHL(\\ Wkl .\\ 0 + \\w khW \\ Q )d8 

Jo c h ieN r (i,j) 

+ f e- Q « (t " s) Y C%MJC(5)e-^ s/2 ds 

C k i£N r (i,j) 

< e~ aijt S + ( e- Q « (t " s) Y C^HLIC(S) (e 7 ° T/2 + e 7o( ® +r)/2 ) e~ los/2 ds 

0 C kl £N r (i,j) 

+ f e" a « (t - s) Y C^MIC{6)e-^ 2 ds 

C kl £N r (i,j) 

( 2 V C kl \ 

- ^c kl €N r (i,j) n U5)\M + LHe l0T/2 { 1 + e 7 ° e/2 )]e“ 7ot/2 . 

2 aij - 70 J 

Thus, the inequality 




< e“ 70 M + 2 dK(5)[M + LILe 70T/2 ( 1 + e 7o ® /2 )]e' 


704/2 < /C(5)e" 7o4/2 


is valid for t > 0. 

Now, let w 1 ^) = {a;L(t)} , w 2 (t) = be elements of One can confirm for t > 0 that 


(iWO))*? 


(n» 2 (t))ij 


< 



g a ij s ) 


E ^(i%(^)i + 

c kl eN r (i,j) 


w ij( s )\) 
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f{v kU + W kls ,v kh(a) +W klj(s) ) - f{v k i s + W kls ,v kh(s) +w kh(s) ) 

+ [ e" a « (t - s) E C ij f(vkis+wl ls ,v kh{s) +wl h(s} ) |^(s)-w?-(s)|ds 
J ° C k i£N r (i,j) 

< /V ay(t ” s) E C%L(H + JC(5)e-^ 2 )(\\wl ls -wlJ 0 + 

J ° c kl eN r (i,j) 

+ f e-°« (t “ s) E C % M K ( fi ) - < ( s ) I ds 


W kl'y(s) ~ W klj(s) 


)ds 


C k ieN r (i,j) 

< (M + 2 LH) sup llto 1 ^) — w 2 (t) I 
t>o 


E /~<ki 
Cu£N r (i,j) °ij 


(l - e “«*) 


+4L/C(6) sup llw 1 ^) — u> 2 (f)| 
t>o 


E 


c. 


kl 


^ e -7ot/2 _ e -aytj 


C k i£N r (i,j) ij ( p - l0 t/2 _ p -ayt 
2aij - 7o 


Therefore, we have that sup ||f[w 1 (t)— IIw 2 (t)11 < Q 2 sup ||w; 1 (t) —in 2 (t)||. Since 0:2 < 1, one can conclude 
t>o t>o 

by using a contraction mapping argument that there exists a unique fixed point w(t ) = {u>^ (f)} of the 
operator II : 4 ',5 —> which is a solution of (14.1011 . 

To complete the proof, we need to show that there does not exist a solution of (14.101) with tr = 0 
different from w(t). Suppose that 6 p < 0 < 6 p+ 1 for some p £ Z. Assume that there exists a solution 
w(t) = {wij(t)} of (14.101) different from w(t). Denote by z(t) = {zijit)} the difference w(t) — w(t), and 
let max ||z(t)|| = m. It can be verified for t £ [O,0 p +i] that 

t£[0,# p +i] 


M*)l < f e- aii{t ~ s) E (®) + ^tfOOl 

Jo C kl eN r (i,j) 

X | f(Vkls +w kla ,V k ly( s ) +w kh{s) ) - f(v k ls +W k ls,V kh(s) + W k h(s))\ ds 

T /" e ^ ^ ^ ^ | f {v k i s T w k i S j v k ij^ T uiki'y(s )) | 

Jo C kl £Nr(i,j) 

< £ CML(H + K:(S))(\\z kls \\ 0 +\\z kh( 4 0 )ds 

C k i£N r (i,j) 

+ f e E CVM\ Zij (s)\ds 

Jo C k i£N r {i,j) 

<9rh[M + 2L(H + IC(5))} E C ij- 

C k i<EN r (i,j ) 


The last inequality yields ||^(t)|| < a^m. Because 03 < 1 we obtain a contradiction. Therefore, w(t) = 
w(t) for t £ [O,0 p+ i]. Utilizing induction one can easily prove the uniqueness for all t > 0. □ 


Remark 4.1 In the proof of Theorem ]^. 1\ we make use of the contraction mapping principle to prove the 
exponential stability. In the literature, Lyapunov-Krasovskii functionals, LMI technique, free weighting 
matrix method and differential inequality technique were used to investigate the exponential stability in 
neural networks They may also be considered in the future to prove the exponential stability 

in networks of the form 
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The next section is devoted to the existence as well as the exponential stability of almost periodic 
solutions of (12.31) . 

5 Almost periodic solutions 

Let us denote by I?o(R) the set of all bounded and continuous functions defined on R. For g £ .Bo(R) 
and a £ R, a translation of g by a is a function Q a g(t) = g{t + a), t £ R. A number a £ R is called 
an e—translation number of a function g £ I?o(M) if || Q a g(t) — g(t)|| < e for every t £ R. Besides, a set 
S C M is said to be relatively dense if there exists a number h > 0 such that [$, i9 + h) fl S ^ 0 for all 
d £ R. A function g £ Bo(R) is said to be almost periodic, if for every positive number e, there exists a 
relatively dense set of e—translation numbers of g US- 

On the other hand, an integer ko is called an e—almost period of a sequence {a p }, p £ Z, of real 
numbers if |a P +fc 0 — a p | < e for any p £ Z [77]. Let Cf* = (, P + q — C P and $ p = Op+q ~ @ P f° r P an d q■ We 
call the family of sequences {C P } ; Q £ equipotentially almost periodic [221 77, 7BJ if for an arbitrary 
positive number e there exists a relatively dense set of e—almost periods, common for all sequences {C P } ) 
q £ Z. 

The following conditions are required. 

(C 8 ) The sequences {C P }i 9 £ Z, as well as the sequences {^ p } , q £ Z, are equipotentially almost 
periodic; 

(C9) There exist positive numbers 9_ and ( such that 0 p +i — 9 p > 9_ and C P +i — ( p > ( for all p £ Z. 

It follows from condition (C 8 ) that there exists a positive number 9 such that condition (C3) is valid, 
and | 0 p |, |£ p | —> oo as \p\ —> oo [221 E. : , IZ5]- 

The next assertion can be proved by the method of common almost periods developed in m (see 
also [73 EE]). 

Lemma 5.1 fT8j Assume that L(t) = {Lij(t)} , i = 1, 2,..., m, j = 1,2,..., n is almost periodic and 
the conditions (C8 ), (C9) are valid. Then, for arbitrary p > 0, 0 < v < rj, there exist relatively dense 
sets of real numbers Q and integers Q such that 

(i) ||Lit + a) - L[t )|| < 77 , t £ R; 

(ii) ICjJ - a I < v, p £ Z; 

(in) |0| — a\ < v, p £ Z, a £ fl, q £ Q. 

The existence and exponential stability of the almost periodic solution of the network (1231) is men¬ 
tioned in the following theorem. 
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Theorem 5.1 Assume that the conditions (Cl), (C2), (C4) — (C 6 ), (C 8 ) and (C9) are fulfilled. Then, 
the SICNN \2.S\) admits a unique almost periodic solution. If, additionally, the condition (Cl) is valid, 
then the solution is exponentially stable with exponential convergence rate 7 o/ 2 . 


Proof. It follows from Theorem Im that ©3D admits a unique bounded on R solution u(t) = {uij(t)}, 
i = 1,2 ,... , m, j = 1, 2 ,..., m, which is exponentially stable provided that the condition (C7) is valid. 
We will show that it is an almost periodic function. 

Consider the operator II defined by equation (14.91) again. It is sufficient to verify that Lht(f) is almost 
periodic, if u(t) is. 

r 1 4LH*r. CkieNr(iJ) c8i 

. 1 ix an arbi- 


Let us denote 8 = max 

Co) 


— + (M + 3 LH ) ^ c ^ N rCo) C i3 + ^n 2 E 


\ — g a ijZ. 


trary positive number e. Because IIu is uniformly continuous, there exists a positive number g satisfying 
6 e 

77 < = and 77 < — such that if 1 1' — t" I < 4t?, then 
'5 1 ~ 3/3 1 1 ' 


||n«(t') - n«(i")ll < 3 - 


(5.11) 


Next, we take into account a number v with 0 < v < g such that \\u(t r ) ~ u(t")\\ < g whenever 
1 1' — t" | < v, and let a and q be numbers as mentioned in Lemma 15.11 such that a is an g —translation 
number for u(t). 

Assume that t £ (dp + g, 9p+± — g) for some pgZ. Making use of the equation 


we obtain that 


(n«(t + a)) tj - (n U (t))« = - f c l 

•J —OG _ A T / - * \ 


C k ieN r (i,j) 


f ( u kl(s+a) ? ^kl^ts+a.) )^ij (-S 4“ Cfc) f (u k l s , 'U'kl'y(s) )^ij (^) 


ds 


+ f e a ’ i A t s ) [ Lij(s + a) — Lij(s)] ds, 

J — OO 


\(Ilu(t + a))ij - (Ilu(t))ij\< f e s) Y C^M \uij(s + a) - Uij(s)\ds 
t c kl eN r (i,j) 

+ [ e^ C%LH\\u kl{s+a) -u kl3 \\ 0 ds 

c kl eN r (i,j) 

+ f e~ aii{t ~ s) Y CijLH\\u kll ( s+a) - u kh{s) \\ 0 ds 
• 7 “°° c hl eN r (i,j) 

+ [ e a ' j ^ t \Lij(s + a) — Lij(s)\ ds. 


(5.12) 


According to Lemma 15.11 (i), the inequality 


f e <Hj{t «) | L ij (s + a)-L i j(s)\ds < 

J — OO 


14 








is valid. Moreover, since a is an 77 —translation number for u(t), one can confirm that 



E C ij M \ u n( s + a ) -Uij(s)\ds < 

C k iEN r (i,j) 


Mr 7 

a ij 


E 


s~ikl 

°ij 


G kl EN r (i,j) 


and 



E CijLH \\u k l( s+a ) 
CkieN r (i,j) 


— WfcZsHg ds < 


£#77 

aij 


E 


s~ikl 


C k iEN r (i,j) 


On the other hand, we have 


^ ^ ^ ^ C^j LH ||n/j;^( s _(_ a ) 'Uki'y(s) ||q ds 

t C k i EN r (i,j) 

< e -°«(*-s) E CijLH ||ufcl 7 ( a + a ) — ti/fc|( 7 (s)+a)|| 0 

• 7ey+I ' c M eN r (i,j) 

00 ^ rOp-\—V _^ 

H - ^ ^ e ^ ^ ^ ||^feZ 7 (s+Q!) u kl(-^(s)+a.) 11 0 (5.13) 

\=o Je p-*-i +r > c kl eN r (i,j ) 

00 ' r&p-x+V 

+ E / e ^ CijLH ||M fc ; 7 ( s+a ) — MfcZ( 7 ( s )+a) || Q ds 

x=0^ C k i€Nr(i,j) 

+ e a ’ 3 ^ ^ E C^LH ||u/ c ;( 7 ( 5 ) +a ) — Ukij( s ) || 0 ds. 
c k ,eN r (i,j) 



For any p £ Z, if s £ ( 9 p + 77 , 9 p+ 1 — 77 ), then one can show by using Lemma |5.11 (in) that the number 
s + a belongs to the interval ( 9 p + qi 9 P +q+ 1 ) so that 


||u 7 ( s+a )-u 7 ( a ) +e J| = max |u(k + C p + 9 ) - u(k + C P + a)\ < 77 , 

/s£[-t,0] 

since |(k + Cp+?) — (k + ( p + ck)| = |Cp — ck| <v by Lemma l5.il ( ii ). Besides, the inequality 


00 rSp-x+r] 

E / e “ 

x=o Je p-^~ r > 


i {t ~ s) ds < 2?7E e "“ i3 '- A = Y 


277 


A—0 


— £ 


is valid. Therefore, (15.131) yields 


e ° w(t s) E C^LH ||ufcz 7 ( s+a ) - UfcZ T ( s )|| 0 rfs 

C k iEN r {i,j) 

kl A TT ST C'kl ' 

.. ... ...... 1 O -*• ^ ^ / 1 , , £1 7Vr / n />’ \ *—' O • 

< LHp 


f 2 J2c k ieN r (ij ) c ij , J2c kl eN r (i,j) 


1 — g a ij§- 


It can be verified by means of ()5.12[) that 


|(Il7t(f + a))ij - (IIu(t))ij| < 77 


— + (M + 3LH)^^l ME. 

&ij CLij 


4LH 2 J2c kl eN r (i,j) C ij 

1 — g —a O'£ 
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Hence, 


\\Uu(t + a) — nw(^)|| < f3r/ < e/3 (5-14) 

for each t that belongs to the intervals ( 9 p + 77, 9 p +i — 77), p € Z. 

The inequality 77 < OJ 5 ensures that t + 3rj £ (0 p + 77,# p+ i — 77) if |t — 0 p | < 77. Now, by means of the 
inequalities (I5.11H and (15.1411 we attain for 1 1 — 9 p \ < 77, p € Z, that 

||nu(f + a) — nu(i)|| < ||nu(t + a) — Hu(t + a + 3rj)\\ 

+ ||nu(t + a + 377) — nu(t + 377)11 + ||nu(t + 377) — nu(i)|| 

< e. 

The last inequality implies that a is an e—translation number of n u(t). Consequently, the SICNN (12.31) 
admits a unique almost periodic solution. □ 

Remark 5.1 The Bohr definition of almost periodicity is also suitable for the application of Lyapunov 
functional method and the technique of Young inequality m to show the existence, uniqueness and 
exponential stability of almost periodic solutions in CNNs. 


6 An example 

Consider the sequence 6 = {9 P } defined as 9 P = p + — | sin(p) — cos(p-\/2)|, p £ Z. Utilizing the technique 
provided in EOT, one can verify that the sequences {$/} , q £ Z, are equipotentially almost periodic. 
We take the function j(t) with = 9 p . One can confirm that the conditions (C3) and (C 9) hold with 
9 = 3/2 and 9 = 1/2, respectively. 

Let us take into account the SICNN 


dxij 

dt 


aijXij / ^ C^j f(xki{'yif) r))xij T L,j (t), 

C k i£N x (i,j) 


in which i, j = 1, 2, 3, f(s) = — if |s| < 0.1, f(s) = 0.005 if |s| > 0.1, r = 0.3, 



an 

Ol2 

013 


9 

3 

5 


«21 

022 

0 23 

= 

6 

5 

4 

\ 

031 

032 

033 l 


. 3 

12 

9 7 


(6.15) 
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Cir 

C12 

C13 


0.08 

0.01 

0.02 

C21 

C22 

9 

w 

= 

0.05 

0.03 

0.06 

C31 

C32 

CO 


^ 0.04 

0.07 

0.02 j 


( 

^n(t) 

L12 (t) 

L13 (t) 




Liiit) 

L22 (t) 

L 23 {t) 



V 

L 3 l{t) 

L32 (t) 

L33 (t) j 




1 0.1 

cos (t) + 

0.2 sin(v / 2 1) 

0.2 cos( 7 rf) + 0.1 sin(v / 2 t) 

- 

0.15 

cos(3 1) 

— 0.1 sin( 7 rt) 

0 . 2 cos(t) — 0.15sin(v / 2t) 


y 0.2 cos(-\/ 2 t) 

F 0.14 sin( 

irt) 

0 . 2 cos(v / 2 1) + 0 . 1 sin(t) 


0.15cos(2i) — 0 . 12 cos( 7 rt) 

0.1 sin(t) + 0.2 cos(v / 3 1) 

0.15 cos(v / 2t) — 0.13 cos(4t) j 


One can calculate that T,c kl eN 1 (i,i) G ii = °- 17 > T,c kl eN 1 (i, 2 ) C i 2 = 0-25, T,c kl eN 1 ( 1,3) C i3 = 0.12, 
ScfeieiVi(2,l) ^21 = 0.28, Z^CfciGJVi(2,2) ^22 = 0-38, J2c kt GN 1 (2,3) ^23 = 0-21, ScfciGJVi^.l) ^31 = 0-19) 
£<^£^(3,2) ^32 = 0.27, J2c kl eN 1 (3,3) C 33 = °- 18 - The conditions (C5) - (C7) are valid for (|6.15|) with 
70 = 3, p = 0.38, c = d = 0.25/3, M = 0.005, L = 0.1, L = 0.35, I = 0.34/3. According to Theorem l5.il 
the network (16.151) has a unique almost periodic solution, which is exponentially stable with the rate of 
convergence 3/2. 

Consider the constant function <b{t) = such that <f>u(t) = —0.025, (f>i 2 (t) = 0.036, </>i 3 (t) = 


-0.014, cf> 21 (t) = 0.012, fa 2 (t) = -0.021, ^ 23 (t) = 0.042, 0 3 i (t) = 0.023, </> 32 (i) = -0.015, ^ 33 (i) = 0.012. 
We depict in Figure Q] the solution x(t) = {xij(t)} of (16.151) with x[t) = </)(t ), t < a = 9q = Figure 
Q] supports the result of Theorem 15.11 such that the represented solution converges to the unique almost 
periodic solution of SICNN (16.151) . 



Figure 1: The unique almost periodic solution of SICNN (16.151) . 
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7 Conclusion 


In this paper, we investigate the existence as well as the exponential stability of almost periodic solutions 
in a new model of SICNNs. The usage of the functional response on alternate (advanced-delayed) type 
of piecewise constant arguments is the main novelty of our study, and it is useful for the investigation 
of a large class of neural networks. An illustrative example is provided to show the effectiveness of the 
theoretical results. 

Our approach concerning exponential stability may be used in the future to investigate synchroniza¬ 
tion of chaos in coupled neural networks and control of chaos in large communities of neural networks 
with piecewise constant argument. 

Differential equations with functional response on piecewise constant argument can be applied for the 
development of other kinds of recurrent networks such as Hopfield and Cohen-Grossberg neural networks 
EQ1E2 and others. This will provide new opportunities for the analysis and applications of neural 
networks. 
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